About the User: Chloe works for Archive.org and has previous experience with the site. She 
primarily uses the Wayback Machine. 


Key findings: 

• Topics list was too long for the user to successfully find the Language filters 

• Different tile sizes (for collections) is misleading, and might be construed as 
collections with larger tiles being more important or containing greater amounts of 
items, not simply an indication of title string length 

• ‘Date Archived’ and ‘Date Published’ could be confusing to differentiate for some 
users 

• User expected filters to be located on the left side of the screen, matching design 
patterns for popular websites such as Amazon and Facebook 

• Hovering over the IA icon to open the navigation drawer did not feel intuitive. 


Testing Notes 

Task 1: Please go to Archive.org 

Task 2: Please go to the ‘American Libraries’ Collection 

Task rating: 1 0 (easy) 

Step A: Complete the task above 

Chloe used the search bar on the homepage (not in nav bar) to search for the ‘American 
Libraries’ Collection. 

On the search results page she quickly found the tile representing the ‘American Libraries 
Collection’ and stated that she was able to identify it as a collection based on its visual 
difference from the other results as well as the indicator that showed the number of items inside 
of it. 

Step B: What are your first impressions of this page? 

Chloe’s first impressions of the page were that the varied size of tiles was confusing. She 
intuitively understood that the collection tiles were different sizes because of varying collection 
title text length, but she also was curious if larger tiles represented larger or more important 
collections. 

Additionally she was unsure of how the collection was organized, the varied tile size made her 
curious of if they were organized by size, after some searching she found the sort bar and saw 
that the collection was currently organized by number of views. 

Task 3: How do you think the items in this collection are currently ordered? 

Task rating: 6 (not easy) 



Step A: Complete task above 

Chloe already approached this question in her last task. 

Step B: How would you sort items in this collection by the date they were added to Archive.org. 
with most recently uploaded items first? 

Chloe was able to locate the date selector tool by mousing over the ‘Date Published’ sort title. 
The titling of ‘Date Archived’ vs. ‘Date Published’ was something she felt might be slightly 
confusing for some users. 

Task 4: How would you view only items that are in English in this Collection? 

Task rating : 9 (easy) however user used a topic filter instead of a language filter 

Chloe was able to locate the filters on the right side of the screen, however she stated that she 
expected them to be on the left side of the screen (like Facebook + Amazon). Additionally she 
noted that she expected to see the word ‘Filter’ somewhere near this section. 

Although she was able to limit the results set, Chloe did not find the ‘Language’ section of the 
filtering options, and instead limited by a topic called ‘English Language.’ This would have 
truncated her actual results compared to using the ‘Language: English’ filter. 

She was easily able to remove her set filter. 

Task 5: How would you find an image of “Children Reading” in this collection? 

Task rating : 8 (moderately easy) 

Chloe utilized the ‘Search this collection’ search bar to search for the string “Children Reading” 
from there she scrolled through the results until she found images of children reading. She then 
wondered if there was a way to filter by media type, after some searching she found this filter. 

Task 6: Item Details Page 

No task rating 

Chloe’s first impressions of the item details page included noting the large image size (this 
image took up two scroll heights). She said that she had expected to see some information 
about the item at the top of the item page, primarily the title, date created and creator. Once she 
had scrolled down, she noted that she wasn’t interested in the majority of the exposed metadata 
fields. Chloe did like the location of the download options as well as the string of tags. 

She quickly located the collection provenance of the item, and then was surprised to find that 
the ‘3 more collections’ link was a link. She was glad to be able to see the other collections, but 
was surprised that what had looked like text to her was a link. 

Task 7: Where would you go to find out more information about one of the collections? 

Task rating : 1 0 (easy) 





Step A: Complete the task above 

Chloe clicked on one of the collection links to go to the collection page. She quickly found the 
‘About tab.’ 


Step B: What are your first impressions of the Collection About page 

Chloe liked being able to see the different stats for the items in the collection, but was curious 
about who the top contributors for the collection were. 


Follow-up Questions 

1. How did this interface match with your expectations of using Archive.org. what parts 
were easy to use and behaved as expected? 

Overall felt easy to use and looks much nicer than VI, which looked dated and like it 
would be hard to learn and use. 

2. In what wavs did this interface not match your expectations of using Archive.org. what 
parts were hard to use, or weren’t quite clear to you? 

Chloe started our conversation by bringing up concerns with the navigation bar’s drawer 
functionality. She mentioned that hovering over the center image did not feel intuitive 
and she was curious how many users would even be able to find this information. 
Additionally the nav bar got ‘stuck’ open during our session, something she felt 
concerned about as well. 

3. If you could change one thing aboutArchive.org. what would you change? 

Chloe had heard about forums on Archive.org but still has been unable to locate them. 
She’d primarily like to use the forums as a way to see what people are talking about in 
collections. She does not currently read reviews. 

4. Have you ever created an account on Archive.org. or would you? Why or why not? 
Chloe signed-up for an account on her first day at the Archive but did not previously 
have an account. She has not yet utilized any features that require an account. 









